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ABSTRACT 



The REEP (Arlington Education and Employment Program) 2 -year 
special project, which set out to research, develop, field-test, and 
establish recommendations for alternative assessment methods for the language 
and literacy development of adult learners of English as a Second Language 
(ESL) , is described and evaluated. Goals and needs of 117 adult students were 
determined, and plans for assessing their progress were developed. Benchmarks 
were created by identifying skills, behaviors, and attitudes indicating 
progress in cognitive, linguistics, and non-linguistic domains. Assessment 
processes and tools were field-tested and refined during the project's first 
year, then were adapted to multiple settings (workplace, drop-in center) in 
the second year. The project also determined the feasibility of aggregating 
data from alternative assessments for reporting purposes, developed a process 
and guidelines for and alternative assessment system in a variety of 
settings, and served as a demonstration site for teachers. It was found that 
the alternative assessment process itself was helpful for teacher 
development, and while alternative assessment is time-consuming, it enables 
teachers to substantiate promotion and retention decisions. Recommendations 
include further exploration of ways to streamline data collection, analysis, 
and reporting, and adoption of ESL proficiency standards for the Commonwealth 
of Virginia. (Adjunct ERIC Clearinghouse on Literacy Education) (MSE) 
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ABSTRACT 

U.S DEPARTMENT OF EDUCATION 
OFFICE OF VOCATIONAL AND ADULT EDUCATION 
DIVISION OF ADULT EDUCATION 
WASHINGTON, D.C. 



353 SPECIAL PROJECT FINAL REPORT 



Title of Project: REEP ALTERNATIVE ASSESSMENT PROJECT 
Contact (Name) Ms. Inaam Mansoor 

(Organization) Arlington Education and Employment Program (REEP) 

(Address) 2801 Clarendon Boulevard 

Arlington, VA 22201 
(Telephone) (703) 358 4200 

Major objectives, and extent to which objectives were met: 



Please note: This project has been a two-year protect . This final report encompasses objectives met over a two-year 
period. 



a. Delineate goals and needs of individual learners and select measures to assess their progress toward these 
goals as well as the impact the program is having on their lives (affective and metacognitive). 

Goals and needs of 117 students were determined through a process appropriate to the English 
proficiency level of each class or, in the context of the Adult Learning Center (a drop-in lab), to individuals 
taking part in the project. In the intensive and workplace ESL classes, instructional plans were developed 
based on the needs assessment through negotiation of the class syllabus. Individual needs were 
accommodated through specific class activities (group/pair work), tutor assistance, and/or use of the multi- 
media learning lab available at REEP. 

b. Create benchmarks for success along the various dimensions of language and literacy learning: cognitive, 
linguistic, and non-linguistic. 

Entry level descriptions provided benchmarks in the linguistic domain, describing skill gains through 
our program as students were promoted from level to level. This project assisted teachers and the 
curriculum staff in refining these descriptions. An in-depth look at writing led to the identification of writing 
proficiency levels into which our instructional levels feed and the development of holistic and analytic 
writing scales to assess writing samples across our program levels. 

The project was also able to identify a list of behaviors and attitudes that indicated progress within 
the cognitive and non-linguistic domains. Evidence of these benchmarks play an important role in 
determining whether or not the learner is ready for the next instructional level. 

c. Reid test a variety of assessment instruments and processes. 

Processes and tools for initial needs assessment and goal determination, on-going progress, and 
promotion/retention were developed, tried, and refined throughout this first year of the project. During the 
second year, tools and processes were adapted to other settings, including workplace and drop-in learning 
lab. 



d. Determine the feasibility of aggregating data from alternative assessments for reporting purposes. 

The collection of progress data is time-consuming and the amount that can be collected is massive. 
Technology offers the possibility of providing assistance both in the collection apd analysis of data through 

the use of pen-based computers. • 

An in-depth look at the development of writing skills enabled us to determine that there are general 
proficiency levels that would describe what a learner could do both to internal stakeholders (learner, 
teachers, administration) and to external stakeholders (community, funders). These are the "standards or 
outcomes" that could be reported. Movement through instructional levels that feed into these proficiency 
levels are indicators of progress along with scored writing samples. A brief look at other skills areas 
indicated such proficiency levels could also be determined for those skills. Thus, establishing outcome 
standards would streamline the reporting process and leave the identification of the indicators (standard 
or alternative assessment) of those standards up to the learner/teacher/program. 
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e. Develop a process and guidelines for putting into operation a system for alternative assessment in a variety 
of ESL settings. 

During the first year, a process was developed for the implementation of alternative assessment 
in an intensive ESL program setting:determining needs/goals, identifying tools and processes for monitoring 
progress towards the goals, and reflecting on achievements and setting new goals. This process also 
worked in workplace, drop-in lab and intensive contexts. However, these contexts required shorter-term 
goals and a tighter match between goals and monitoring procedure. 

A teacher training module was developed to guide other programs through alternative assessment 
implementation. 

f. Serve as a demonstration site. 

The REEP program was selected as a site visit for participants at the TESOL (Teachers of English 
to Speakers of Other Languages) Convention during the first year. Seventeen visitors participated. Over 
1 00 other visitors participated in monthly Visitor Days at REEP since the project began. The majority were 
teachers and volunteers from various ESL programs in Virginia. Information was disseminated on the 
Alternative Assessment Project and participants had an opportunity to visit the classes where the process 
was being implemented. 

4. Project findings: 

a. The implementation process itself was of great value as a staff development tool no matter what the 
teaching context. Teachers gained confidence in their own ability to assess learners and began to integrate 
assessment throughout the instructional process-identifying learner goals, tracking progress, reflecting on 
achievements and setting new goals. Even if the teachers were specifically observing only a few students 
from the class for the purpose of this project, they found that their observation and assessment skills spilled 
over to enrich the entire class. 

b. Alternative assessment is a time-consuming process. There are many "layers’ to be addressed: funders 
and administrators, program and classroom, and the learners themselves. Indicators of learner success to 
each may be different and need to be accommodated. Alternative assessment instruments and processes 
take more time to implement than giving a standardized test or exercise and more time to interpret as 
results are not usually easily quantifiable. Yet they can be used to indicate the outcomes learners have 
achieved. 

c. Alternative assessment enabled teachers to substantiate decisions for promotion and retention. 

d. The project team meetings and small study groups were a vital source for creating commitment and mutual 
support as teachers implemented alternative assessment in their classrooms or worked to develop 
assessment tools. 

5. Project recommendations: 

a. Ways to streamline the collection, analysis, and reporting of data need further exploration. Technology has 
the potential to assist. Pen-based computers offer the possibility of recording incidences of progress as 
they occur in the classroom, cutting down the time (and memory) needed for the teacher to note progress 
gains and aggregate data. There use should be further explored. 

b. ESL proficiency standards should be adopted for the Commonwealth of Virginia so that programs could 
report learner outcomes in a consistent manner yet still have the flexibility of determining what each 
learner's level is, whether through standardized or alternative assessments. 

6. Potential influence of project on State Adult Education program: 

a. The project supports DAE's Performance Indicators in seeking ways to document the progress learners are 
making toward their education goals and in providing staff development. It can serve as a model for the 
development of standards that can be used to report learner progress uniformally throughout the 
Commonwealth. 

b. The project yielded a process which can be used by other ESL programs in the Commonwealth to 
implement alternative assessment. 

O 
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Section I. OBJECTIVES 



. , The REEP Alternative Assessment Project has been a two-year initiative to 
research, field-test, and establish recommendations for the use of alternative 
assessment procedures to evaluate language and literacy development of adult ESL 
learners. For this project, alternative assessment is defined as "any method of finding 
out what a student knows or can do, that is intended to show growth and inform 
instruction and is not a standardized or traditional test" (Valdez-Pierce and O'Malley, 
1992, "Performance and Portfolio Assessment for Language Minority Students," 
Washington, D.C.: National Clearinghouse for Bilingual Education). During the first 
year, various alternative assessment tools and processes were developed, field-tested, 
and refined for seven levels of the Intensive ESL component of our program. 
Participating classes and their teachers were phased in over a 9-month period. During 
the second year, the alternative assessment tools and processes were adapted and 
implemented in two additional settings: Workplace classes and the Adult Learning 
Center (ALC), a drop-in learning lab. Our program evaluation framework was revised 
to integrate alternative assessment and led to the validation of instructional level 
descriptions and the creation of holistic and analytic writing scales to assess writing 
across all program levels and contexts. 

Objectives for the two-year project were as follows: 



A. Delineate goals and needs of individual learners and select measures to 
assess their progress toward these goals as well as the impact the 
program is having on their lives (affective and metacognitive) 

B. Create benchmarks for success along the various dimensions of 
language and literacy learning: cognitive, linguistic, and non-linguistic 

C. Field test a variety of assessment instruments and processes 

D. Determine the feasibility of aggregating data from alternative 

assessments for reporting purposes 

E. Develop a process and guidelines for putting into operation a system for 
alternative assessment in a variety of ESL settings 

F. Serve as a demonstration site 



Section II. HOW WE MET THE OBJECTIVES 



A team consisting of the director and coordinator of the project, a consultant 
with experience in alternative assessment, coordinators from other program 
components and two teachers was formed to implement alternative assessment in the 
first instructional cycle. A decision-making framework was established which called 
for determining program/class/learner needs, defining success in language and literacy 
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development, identifying means to monitor progress toward and achievement of goals, 
and documenting the implementation process. The primary vehicle for making 
implementation decisions throughout the first year became the weekly project team 
meetings (coordinator and teachers). During the second year, various study groups 
were formed to implement activities to meet the project's objectives. 

Objective A : Delineate goals and needs of individual learners and select measures to 
assess their progress toward these goals as well as the impact the program is having 
on their lives (affective and metacognitive). 

Needs assessment is fully integrated with instructional planning during each 
teaching cycle, no matter what the instructional context: intensive ESL, workplace, 
ALC. It comprises a part of the first curricular unit at each level. Teachers select a 
process and/or tools appropriate to the proficiency level of students in their class. 
Instructional plans are then negotiated based on the needs assessments. Individual 
needs not accommodated through the class syllabus can be met through tutor 
assistance and/or use of the multi-medial learning lab available at REEP. 

Progress was noted in a variety of ways, depending on the content and level 
of the class. Linguistic and content knowledge were recorded at all levels and 
contexts for each student on an individual progress report that reflects content 
competencies and skill level assessment. New instruments introduced at all levels to 
record progress in the three domains of linguistic, cognitive, and non-linguistic, 
included teacher logs, teacher observation grids, and portfolios with a content 
summary sheet. Other class/level specific instruments and processes were also 
explored such as audio/video taping, surveys, and special projects. (See Appendix A 
for an annotated listing and examples.) 

As the project progressed, the need to identify expected outcomes at each level 
became apparent. These outcomes would enable learners to have a profile of their 
accomplishments and capabilities. Criteria for the development and scoring of 
assessment tasks to validate these outcomes could then be established. Two study 
groups were formed, one to look at writing skills and the other to look at oral skills. 
The Writing Group collected and analyzed actual writing samples across all program 
levels and contexts to identify what students could actually do at each instructional 
level. The writings fell into three proficiency levels. A holistic scale (with three 
proficiency levels) and an analytic scale (with seven defined levels of development 
across 8 categories of aspects of writing) were developed (Appendix B). These levels 
and scales were then checked against our 8 instructional level descriptions and their 
curricular objectives yielding a high correlation. The Oral Proficiency Group taped 
interviews with students at 2 levels (250 and 550) to determine what they were able 
to talk about, with what level of proficiency and confidence, and under what 
circumstances. The task of collecting and analyzing speech samples was extremely 
laborious and time consuming so that no definitive conclusions were reached. 
However, we suspect that there are three to four levels of speaking proficiency into 
which our instructional levels fall. This merits additional study and could yield data 



from which to build a systematic assessment of oral skills. 

Impact on students' lives has been the most difficult to determine. Surveys 
conducted periodically while students were still in class provided some insight. Such 
surveys indicated a growing awareness of environmental print and use of English 
outside of class. Follow up once students had left the program was not feasible due 
to time and personnel constraints. 



Evaluation plan: 



Strategies 


Outcomes 


Outcomes to date 


1.1 Select needs assessment 
methods and instruments to 
determine goals and needs of 
each student 


1.1 Goals for 115 students will 
be determined and recorded 


1 . 1 Goals for 1 1 7 students 
have been determined and 
recorded 


1 .2 Develop a plan of 
instruction to meet those goals 


1 .2 Instructional plans for 1 1 5 
students will be developed and 
recorded 


1 .2 Instructional plans for 117 
students have been developed 
and recorded 


1.3 Select/create measures of 
progress 


1 .3 Progress will be assessed 
and recorded 


1 .3 Progress has been 
assessed using various tools 
and processes 


1.4 Select/create impact 
measures 


1 .4 Impact will be assessed 
and recorded 


1.4 Impact noted through 
classroom reporting 



Objective B (2): Create benchmarks for success along the various dimensions of 
language and literacy learning: cognitive, linguistic, and non-linguistic. 

Benchmarks in language development were established through a concurrent 
curriculum revision process. The implementation of alternative assessment assisted 
in the refinement of entry level descriptions for each of our instructional levels. These 
entry level descriptions serve as benchmarks indicating progress in language 
proficiency. The research conducted by the REEP's Alternative Assessment Writing 
Group validated the level descriptions and curricular objectives by correlating them to 
the three general proficiency levels defined through actual student writing samples. 
Writing scales have been created to assess benchmark attainment. Initial exploration 
of oral skill proficiency is leading toward similar conclusions. 

Cognitive skills are indicated in some level descriptions. Other cognitive and 
non-linguistic benchmarks were noted by teachers and a list was compiled. As an 
outgrowth of this project, a group of three teachers and the project coordinator 
formed a research study group through the Virginia Adult Educators Research Network 
to further explore the non-linguistic benchmarks. Preliminary data indicate that these 
benchmarks tend to overlay the linguistic. Their development appears to depend on 
a variety of factors such as personality, previous educational experience, stage of 
culture shock, living conditions, work experience both in native country and the U.S. 



Although a chronology of development is difficult to observe, the emergence of these 
benchmarks aids the teachers in making promotion and retention decisions. (See 
_ Appendix YYY for definitions and indicators of evidence of the non-linguistic 
benchmarks explored by the research group.) 



Evaluation plan: 



Strategies 


Outcomes 


Outcomes to date 


2.1 From students' goals and 
needs, choose areas critical for 
success to be evaluated 


2.1 Critical areas will be 
identified for each goal 


2.1 Critical areas have been 
observed in each level where 
alternative assessment has 
been implemented 


2.2 Set incremental steps that 
will indicate movement toward 
success 


2.2 Incremental benchmarks 
will be identified 


2.2 Benchmarks for all skill 
areas have been identified. 
Cognitive and non-linguistic 
indicators appear to overlay 
the linguistic 


2.3 Select/create a 
method/instrument to evaluate 
that movement 


2.3 An array of instruments to 
measure progress, depending 
on goals, will be catalogued 


2.3 A variety of instruments 
and methods have been 
identified and/or created 



Objective C (3): Field test a variety of assessment instruments and processes. 

Several instruments and processes were developed and/or field-tested during 
this first year. Adaptations were made during the second year to accommodate new 
contexts: the Adult Learning Center and workplace classes. (Appendix A) The needs 
assessment processes lend themselves well to adoption in the new contexts, although 
the actual instrument may need to be refined. For example, A needs assessment in 
a workplace setting would reflect the roles that the employees engage in on the job 
as opposed to the lifeskill role orientation of the general intensive ESL context. 

The original intent had been to expand implementation to a fourth context: non- 
intensive ESL classes. Meanwhile, Fairfax County Adult ESL, with whom we had 
intended to work, had already begun implementing alternative assessment in their 
non-intensive classes. Rather than duplicate an implementation process, we provided 
training to their teachers through VAILL-ESL, REEP cluster training, participation in 
REEP in-services, and participation by the project coordinator in their alternative 
assessment team meetings. 

Common to implementation of alternative assessment in all three additional 
contexts was the challenge to carefully define short-term goals that could be 
accomplished in the limited amount of time and to choose assessment tools that were 
capable of showing growth and development towards meeting those goals. 
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Evaluation plan: 



Strategies 


Outcomes 


Outcomes to date 


3.1 Implement use of 
alternative 

assessment instruments 


3.1 Use of alternative 
assessment in first cycle 


3.1 Alternative assessment 
was implemented in seven 
levels 


3.2 Meet with teachers and 
students to analyze data 


3.2 Recommendations for 
adoption/adaptation of 
procedures and instruments will 
be made 


3.2 Recommendations were 
made by teachers for 
subsequent cycles 


3.3 Adapt/adopt procedures 
and instruments 


3.3 Procedures and instruments 
will be amended 


3.3 Instruments were refined 
and others were developed 


3.4 Implement procedures and 
instruments in following cycles 


3.4 Use of alternative 
assessments will be phased in 
over the next two program 
cycles 


3.4 Implementation was 
phased in to include seven 
instructional levels by the end 
of the first year of the project 


3.5 Continue to analyze data 
and make recommendations 


3.5 Adjustments will be made 
to procedures and instruments 
as implementation is extended 
to three more contexts 


3.5 ALC and workplace 
teachers adapted processes 
and tools and implemented 
alternative assessment in 
these two contexts. Technical 
assistance was provided for 
implementation in non- 
intensive classes 



Objective D (4): Determine the feasibility of aggregating data from alternative 
assessments for reporting purposes. 

The collection of alternative assessment progress data is time-consuming and 
the amount of data that can be collected is massive. A portfolio summary sheet was 
designed with the idea of its usefulness for reporting and recording keeping purposes. 
This led to the redesign of the attendance card (Appendix C) and pointed to the need 
for the development of a learner profile that would provide stakeholders with 
information about the learners goals, progress toward meeting them, outcomes (what 
a student can do), affective behavior and strategies (how they go about it), and 
contexts (range of support necessary. The establishment of writing proficiency levels 
and the creation of writing assessment scales that show how learners progress as 
they move through our instructional levels hold promise for the creation of such a 
profile. However, such proficiency levels and assessment tasks and scales need to 
be developed for other skill areas before a complete profile can be developed. 
Establishing such outcome standards would streamline the reporting process and leave 
the identification of the indicators of those standards up to the 
learner/teacher/program. 

Technology also holds promise for assisting with the collection and analysis of 
data. Our search for ways to facilitate the process, led to the discovery of the 
potential of pen-based computers. Two applications, one on IBM-based equipment 
(Tycho) and the other on Apple-based "Newtons" (Learner Profile), are capable of 
assisting teachers in recording data as it is observed in the classroom and transferring 
it to a data bank that assists in analyzing it. This would enable teachers to keep their 
assessemnt focus on the learner, and, at the same time, aggregate data program-wide 



for analysis that can assist in program planning for continued effectiveness and 
accountability. It also holds the potential for validating indicators and outcomes. 
These uses of technology merit further study. 



Evaluation plan: 



Strategies 


Outcomes 


Outcomes to date 


Consider reporting formats in 
view of field test data analysis 
and advisory board 
recommendations 


Recommendations for reporting 
alternative assessment data 


Recommendations include the 
development of learner profile 
that uses technology to assist 
data collection and analysis 



Objective E (5): Develop a process and guidelines for putting into operation a system 
for alternative assessment in a variety of ESL settings. 



Our own implementation process and reflections on its successes and 
challenges were recorded in order to assist in the development of a guide useful to 
other programs wishing to implement alternative assessment. A training module was 
developed, field-tested at VAILL-ESL '94, modified, and delivered during a REEP 
cluster training series to a group of teachers and volunteers from the northern Virginia 
area. The participants represented a variety of instructional contexts including one-on- 
one tutorials, volunteer-taught and professional-taught non-intensive programs, and 
intensive programs. Evaluations and feedback indicated that this module serves as 
a guide for others who wish to improve their understanding of alternative assessment 
and implement it in their own classrooms. 



Evaluation plan: 



Strategies 


Outcomes 


Outcomes to date 


5.1 Review the implementation 


A guide describing the process 


5.1 Implementation in three 


process in each of the four 


and how to implement it 


instructional contexts has been 


settings 




documented. 


5.2 Make recommendations for 




5.2 Teachers have made 


use of alternative assessments 




recommendations and field 
tested instruments/processes 


5.3 Develop a guide to assist 




5.3 A training module has 


other programs in replicating 




been developed to guide 


the alternative assessment 




programs through the 


process 




implementation process 



Objective F (6): Serve as a demonstration site. 

Visitors included over 100 teachers and volunteers from Virginia and other 
states. Among the visitors were Madeleine Kunin, Deputy Secretary of Education; 
August Kappner, Assistant Secretary for Adult and Vocational Education; Andy 
Hartman, Director for the National Institute for Literacy; Alice Johnson, staff aide to 
Senator Paul Simon, and seventeen participants in the International TESOL 
convention. Information was disseminated on the Alternative Assessment Project and 
visits were made to classes involved in the implementation process. 

Several trainings and dissemination presentations were also made by project 



staff. These include two International TESOL conventions (1994 and 1995), VAILL- 
Petersburg and VAILL-ESL '94, VAACE '95, program in-services, and REEP Cluster 
Training. As a result of the presentations, inquiries about the project have been 
received from Vancouver, British Columbia, Australia, and other programs in Virginia. 
Articles have appeared in the WATESOL News and VAACE newsletter disseminating 
project findings. 



Evaluation plan: 



Strategies 


Outcomes 


Outcomes to date 


6.1 Develop a seminar/training 
module 


6.1 Hold at least one seminar 
for 1 5 teachers 


6.1 Implementation process 
was documented in order to 
prepare training materials. 


6.2 Disseminate findings in a 
variety of professional settings 


6.2 Present at VAACE, VAILL, 
and such conferences as well 
as send guide, reports, and 
training module to the Virginia 
Resource Center and ERIC 


6.2 Project staff presented 
findings and conducted 
training 

at various state and national 
conferences, two articles have 
been published in local 
newsletters, and a training 
module has been developed. 


6.3 Provide opportunities for 
teachers to observe classes 
where alternative assessment 
is in place 


6.3 At least 5 teachers from 
around Virginia will have visited 
REEP classes 


6.3 Over 100 visitors, the 
majority being teachers and 
volunteers from Virginia, have 
received information on the 
project and observed REEP 
classes 



Section III. Summary 

The implementation of alternative assessment has been a "process" through 
which the project team has considered the definition of literacy and language 
development, what indicates success, how to monitor on-going progress towards 
goals and document achievements. This process has been translated into a training 
module that will guide other programs and future REEP staff as they implement 
alternative assessment in their own classrooms. The implementation process itself 
was a valuable staff development vehicle no matter what the teaching context. It 
encouraged teachers and learners to take a critical look at what counts as progress, 
how to capture it, and how to report it. Teachers gained confidence and skill in 
assessing learners and began to integrate assessment throughout the instructional 
process-identifying learner goals, tracking progress, reflecting on achievements and 
setting new goals. Even if the teachers were specifically observing only a few 
students from the class for the purpose of this project, they found that their 
observation and assessment skills spilled over to enrich the entire class. 

This project has also enabled us to define more concretely the work that lies 
ahead. A framework for the creation of a learner profile has been identified: 
proficiency level descriptions reporting outcomes and instructional level descriptions 
reporting achievement of incremental benchmarks in language and literacy 
development. The work accomplished with writing skills provides a model for future 
work defining proficiency and outcomes in other skills and creating tasks and scales 
to assess them. 



Although many of our initial questions have been answered, new questions 
have been opened: What is the relationship between proficiency levels and 

instructional levels in each skill area? How can data collection be efficiently managed? 
How can technology assist not only the collection but also the analysis of alternative 
assessment data? What should a learner profile look like? Who will benefit from 
knowing the information? The process, just like the one we implemented in the 
classroom, continues: setting inquiry goals, monitoring our progress toward them, 
reflecting on achievments, and setting new goals. 



ALTERNATIVE ASSESSMENT 
TOOLS AND PROCESSES 



REEP Alternative Assessment Project 
353 Special Project 
July 1, 1994- June 30, 1995 



Compiled by Carol Van Duzer 
Instruments have been created or adopted/adapted 



Alternative Assessment 

Definition and Underlying Principles 

Alternative assessment can be defined as "any method of finding out what a 
student knows or can do, that is intended to show growth and inform instruction and is 
not a standardized test" (Valdez-Pierce and O’Malley, "Performance and Portfolio 
Assessment for Language Minority Students," National Clearinghouse for Bilingual 
Education, 1992). What, how, and why a program chooses to assess are shaped by the 
program’s view of what consitutes literacy and language development. Increasingly 
programs are considering both linguistic and non-linguistic factors (Wrigley, "Learner 
Assessments in Adult ESL Literacy, National Clearinghouse on Literacy Education, 1992). 
What do the learners need or want to know? What are they actually learning? What 
indicates learner progress to the teacher? To the learners themselves? What needs to 
be documented for the learner, the teacher, the program administrators, the funders, and 
other interested parties? These questions, which should be answered as a program 
considers alternative assessment, imply certain principles underlying the conceDt of 
alternative assessment: 

--It must be program-based and learner-centered 

—It should help learners achieve their goals 

-It must build on learner strengths, not deficits 

-It must be a process done with the learner and not to the learner 

-It must be part of the learning experience 

—It should not be a single procedure, but a variety of procedures 

-It should provide feedback that will lead to better instruction 

(From McGrail, "Learner-Centered Approaches to Assessment: Developing a 

Framework," In-depth session at VAILL-ESL’93) 

These principles encompass three phases of alternative assessment: initial 
assessment including placement and needs assessment, on-going progress, and 
achievements and reflections. It is a continuing process in which the monitoring of on- 
going progress may alter the goals or path to achieving them and reflecting on 
accomplishments may lead to new goals that set the stage for the next instructional step. 



Initial Assessment 

Initial assessment assists programs in placing learners within the existing 
framework of the program or in setting up a course of study for a particular learner or 
groups of learners. Such assessment may consist of finding out what learners can do 
with language and literacy (speaking and reading and writing samples), what their needs 
and goals are (goal setting activities), where and how they use language and literacy 
(surveys and inventories), what strategies they use to make sense out of what they hear 
and read (surveys and interviews). The initial assessment process may occur prior to 
placement in program, in a particular class itself, or partially prior and partially in the 
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class. For example, a placement procedure may determine at what level a particular 
learner should study and then classroom procedure may assess learner need and goals 
to establish a course of study. 



On-going Progress 

On-going assessment documents progress the learners are making toward the 
goais established and program of study set up as a result of the initial assessment. It 
should inform learners as to their development and teachers as to learners’ needs so that 
instruction remains relevant and effective. It should be integrated in such a way that it 
becomes part of the learning process. Weekly summaries (what have learners read, 
where have learners used language/literacy, what is the learner learning), development 
of a learner portfolio (samples of writing, tasks accomplished), processing activities (were 
they easy/difficult, what made them so, what strategies helped) are just a few of the types 
of on-going assessment activities in which to engage the learners. 



Achievements and Reflections 



During the achievement and reflection phase of alternative assessment, learners 
and teachers look back over the instructional period to assess whether goals have been 
met and progress has been made according to the program’s standards or definition of 
progress in language and literacy development. Decisions may be made about promotion 
or retention, goals may be refined and redefined, documentation of progress may be 
recorded, the learning experience may be evaluated. As the learners relect on their own 
learning, the teachers should also reflect on their teaching: what worked, what didn’t why 
what to do differently/the same next time, how will this effect their teaching practices’ 
The program as a whole looks back to see how the program has done in its mission to 
move learners forward in language and literacy development. 



Thase three phases of alternative assessment do not always proceed in linear 

^ / * re • cyc,icaL ^ ie *' ne between on-going assessment and 
achievements/reflections may blur as goals are met or redefined and as instructional 
plans develop. Alternative assessment is not static but moves in response to the evolvina 
goals and needs of the learner, teacher, and program. a 



Conducting Initial Needs Assessment in the ESL Classroom 



Needs assessment is most successful when students understand its purpose and 
are comfortable with each other. It does not happen cold on the first day of class. 
Students need an opportunity to get to know each other and the teacher. Students begin 
to open up as they acknowledge shared concerns and build a community in the 
classroom. Several days may be spent discussing where they use English, what 
problems they have encountered and why they feel they need to improve their language 
skills before attempting any formal documentation of needs. 

The following tools and processes represent the efforts of REEP teachers at 
determining needs and interests of their classes. However, the processes and tools can 
be adapted for use in tutorial and individualized instruction contexts. Students with lower 
English proficiency usually need more prompting assistance in articulating needs than 
those with higher proficiency. Opportunity should always be provided for students to 

express needs that may not be represented on prepared activity sheets nor accounted 
for in the curriculum. 

Processing the information together enables all the students, along with the 
teacher, to see the various needs represented in the class-- needs that may be similar 
or vary greatly. The information is used to establish the instructional plan for the cycle, 
and set up ways to meet individual student needs apart from the class (with a volunteer! 
as part of a focus group, or supplemented through study in our Learning Center) The 
community building continues as students agree to study English through the contexts 
representing the greatest needs in the class. 



Tools and Processes 



PICTORIAL QUESTIONNAIRE 

1 . Choose pictures that depict the curricular units of the instructional level and copy 
them in random order onto paper to construct a “questionnaire." 

2. Review the pictures with the class to ensure students understand what each 
picture represents. 

3. Have students select 5 (or another number that can be covered in the instructional 
time period) they are interested in studying. 

Variations: Skill tally-select pictures that represent the four language skills 
(listening, speaking, reading, writing), talk about what each is and where/why 
students use it, have students rank order their own priorities. Whole-bodv 
y otinq (Vote with your feet)--put the pictures up around the room (rather than on a 
questionnaire") and have students stand next to the picture that represents their 
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greatest need. Repeat several times so students can rank their top 4-5 priorities. 
Use of a picture dictionarv-can substitute for a picture questionnaire, identify 
_ r pages in the dictionary that correspond to possible contexts of study, discuss what 
each is about, then take a ballot vote with students selecting the 5 most important 
to them. Cut-out ill ustrations -students cut out pictures from magazines of things 
they would like to be able to do with English. 

REACHING GROUP CONSENSUS 



Grid tally: 

1 . Have students work in groups of 3-5, tallying their responses on to a grid (or using 
a questionnaire sheet). 

2. Within each group, have the students reach consensus on the top (5) needs of 
their group. 

3. Have each group report their priorities to the entire class, recording the results on 
the board or tear sheets. 

4. Have the entire class come to consensus on topics and skills on which to 
concentrate that cycle. 

Picture cards: (priority cards) 

1 . Have students work in groups of 3-5. 

2. Distribute to each group a pack of cards with needs assessment pictures (can be 
cut up from the questionnaire). 

3. Have each group come to consensus on the rank order of topics, placing the cards 

in order. (It may be helpful to have them agree on 4-6 topics before rank orderinq 
them.) 



POINT OUT THAT THESE ARE THE TOPICS THAT WILL PROVIDE THE CONTEXT 
FOR THE ENGLISH THEY WILL STUDY IN THE CLASS. 



BRAINSTORMING (learner-generated lists) 

1 . Students list one or more of the following: 

--reasons they want to study English 
--when they need to speak English 
--where they need to use English 
—with whom they speak English 

-where/when/with whom they have problems using English 
-other 
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2. This list may be used to construct a questionnaire or as basis for individual 
students to choose the 4-6 topics they would like to work on. during the cycle. 

3. Then have students work in groups to come to a consensus. 

Variation: Ballot voting-students can write on a piece of paper their top three 

choices. Tally the results on the board or tear sheet to determine areas of 
greatest need/interest. 

WRITTEN QUESTIONNAIRE 

1. Based on brainstorming or curricular units develop a list of possible topics (Mav 
use progress report.) 

2. Present the list individually or on the overhead. 

3. Have students select individually their areas of interest/need. 

4. Then have students work in groups to come to consensus. 



FOUR CORNERS (form of whole-body voting) for determing language skill needs 

1 . Write each of the 4 language skills on a sheet of paper and post one in each of 
the 4 comers of the room. 

2. Ask students to move to the corner that represents one or more of the following- 

--what they need/use the most 
--what they need/use the least 
--their greatest strength 
--their greatest weakness 
-other 

3. Note areas of greatest concern so the class can come to consensus on skills to 
concentrate on for the cycle. 



USAGE/PROBLEM CHARTS 

1* Prepare a grid so students can keep track of where, when, and with whom they 
use English and/or wanted to use it and had a communication problem. 

2. Have students keep track of this information for a designated period of time (a 
week or two). v 
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Have students bring the information back to the class to tally and analyze. 
Come to consensus where need to concentrate study for the cycle. 



COMPOSITIONS OR JOURNALS 

1. Have students write a composition or in their journals about their needs and 
interests in studying English. 

2. Students can share these with the teacher and/or each other, extracting needs to 
form a basis from which to reach a class consensus or use in conjunction with 
other needs assessment instruments to determine individual needs. 



WRITING SAMPLES 

1 . Writing samples should be taken within the first days of class to ascertain writing 

development needs. a 

2. Topics concerned with why students are studying English and/or what their 
education and work goals might be could be suggested. These writings would 
then be shared with the teacher and with each other and used as a basis for 

developing a list of possible contexts/skill areas on which to build an instructional 
plan for the class. 



INDIVIDUALIZED EDUCATION PLAN (IEP) 

1 . Have each student fill out a form requesting information on past and present work 
and education experience as well as long and short term goals. 

2. Use this form as a basis to discuss areas of study the class might want to consider 

3. Come to consensus on topics. 



Initial Needs Assessment 



Level 100 

--picture questionnaire 
--grid tally 

Level 150 

--picture questionnaire 
--individual, then group consensus 
--grid, class tally 

-brainstorm reasons they want to study English 
Levels 100/200 

-brainstorm when need to speak 
-whole body voting using pictures 

Level 200 

-plan of class (?) 

-progress report checklist 
-grid/group work 

-small group work, rank order 5 topics chosen from curricular list 

Level 250 

—picture questionnaire, individually then group consensus 

-asking overtime (2 weeks) why studying English, where need more Enqlish 
-rank order topics 

Level 300 

-face drawing: I have problems with Englilsh, I use English, goal, best year 
—class tally, rank order in groups 
-practice/problem survey 

Level 350 

-progress report on overhead, group prioritize 
-4 corners for language skills 

-small group work tear sheets: where they use and need English 
-curricular topic and skill survey of priorities (individually) 

Level 450 

-4 corners for language skills 

-Venn diagram “our team" for curriculum, “I need to study . . . most," “I need 
English for . . (most useful for topic NA on individual comps) 

-grid, This weekend I used English . . (name, where, with whom, for what, any 
problems), served to stimulate thinking 

-summary of curricular content on overhead, groups select 5 
—journal entries to pen pals, intro video 





—small groups list where use English and what read and write 

Level 550 

—grid, "Why are you studying English?" 

-questionnaire (problem areas, skill priority, curricular units) 

-self-evaluation form 
-reading/writing practices 
-describing self as learner 

-brainstorm "should study" and curricular topics: order individually, then come to 
group consensus 
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Consumerism 
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Time, and Wea4k*r_ 
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V. r^k 







2&G /G/9tf 




Date 



Group Narae^_ 

^ r*i J 

What does your group say? 

Why do you want to study English?, 



What do you need to practice? Speaking 

Listening 

Reading 

Writing 

Grammar 

Do you practice English after class? 



o 

ERIC 



30 



DATE ta l°l */ 

~ ~piease explain why you need more English. Be specific with examples of situations which are 
difficult for you now. 

2. What problem area do you want to improve before you leave this class? 

3. When people speak English to you, do you understand: 

1 00% 80% 65% 50% less than 50% 

4. When you speak English, do people understand you: 

100% 80% 65% 50% less than 50% 

'5. When you watch TV, how much do you understand? 

everything most some a little — very little 

6. Please ORDER the skills that you need' from 1 to 6. Number 1 is the most Important and 6 i 
the least Important to you at this time. Please use each number only once. 

READING 

WRITING 

LISTENING 

SPEAKING 

VOCABULARY 

PRONUNCIATION 

7. Have you ever studied English in the past? yes no How long? 

Where? . When? 
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To: Susan 

From: Deborah 

Re: Needs Assessment 200/250 Barcroft 

August, 1994 



My needs assessment begin the first day of class when I 
the board and asked students to fill it in: 



put this chart on 



Today 1 used English 


speaking 


listening 


reading 


Writing 










w 



We started each class for a week talking about where/with whom etc thev 
inrt^rT Sm9 Eng ,sh ‘ ( That>s when we discovered that most English writing 
Ste 9 !) my ° Wn ' WaS Si9nin9 ° Ur names on checks and "edit card bill 

The beginning of the third week I had students line up in the order of how 
ong the/d been in the US and then count off into small gVoups (of 4) T 
like to have a mixture of time in the US in these groups though sometimes I 

together j 9 ^ *° h3Ve ■°' d tlmerS " ,0gether and ‘newcomem' 

We brainstormed the different places where they use English Then I 
aakad th H? t ° thlnkab0ut where ,he y had trouble using English I 

rT ,* ha | t , there | were so many things I could teach them in the 
ext 9 weeks, but that I wanted to be sure I was teaching what they 

"®! d .® d/wan,ed t0 know - Tha t this activity would help me determine what it 
was they were coming to school for so that I would not be wasting their 
precious time in the classroom. They liked that. 9 

Next, I handed out the attached questionnaire and had students fill them 
out ind'viduai'y. After finishing the individual questionnaires, I had them 
work together as a group to come up with 5 and then 3 topics. It worked 
better than I had thought it would for this level. It took around 1 hour 
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NAME 



A. Ask yourself the following questions: 



Where do I use English? 

When do I use English? 

Where and when do I have problems because I need 



more English? 



™ y ^ ,ngs you 03,1 stucJ y durin 9 next 10 weeks. Look at the 
hst below, think about your answers to the questions above, and check (✓) 

the 5 topics that you think are the most important. 



CU Government (Study about the system of government in the U.S.) 

□ Community Services (Study about the library and community agencies.) 

□ Banking (Study about filling out forms for the bank, writing checks, etc.) 

CD Consumerism (Study the English you need for shopping.) 

D Health (Study the English you need for going to the doctor.) 

landlord 1 ) 8 * n9 En9,iSh y ° U for finding an a P artment talking to your 



CD Telephone (Study the English 
using the phone book.) 



you need for using the telephone and study about 



( ^ d I the En9listl you need for asking for and giving directions 
Study about schedules. Study about traffic signs.) 



CD Working in the United States (Study the English 
Study the English you need at work.) 



you need for finding a job. 



B. Look at the 5 topics you checked. Which 3 are the most important? Put 
them in order 1 = most important. 




of years completed in school _ 
Are you working? Yeg 
what is your job? 



No 



Put a check ( ) after the following - 



1. !&SB do you speak English? Do you scsak English 
at work 



at the grocery store 
at a department store 



speak with my child's 
teacher 



speak with my landlord 



. speak w/American friends 
friend fr . other countries 



when I speak on/answer the telephone 

when I speak w/ my doctor t _ 11r „ 

talk to my neighbor 

(what nationality?) 



speak to the repairman 



speak with my boss 



speak English at school (Barcroft) w/teacher & classmates 

wnere you have to speak English) 7 ° therS (give other examples 



2 . 



Do you read 



When do you read in English? 

English newspapers 

street signs 

letter from my child's teacher 

memos at work 

Help Wanted ads 

appliance instruction manual 



English magazines 
my child's homework 



job application forms 
Now Hiring signs 
rental contract 



tone 

igna at work (bulletin boards, schedule, etc.) 

Read telephone messages _ stories in books 



letters from other people (in English) 



read doctor's prescriptions 
read labels of clothes 
read recipes 
read water bills 



nave to read in English) 



Others 



sale prices in stores 
read medicine labels 
read telephone bills 
read credit card bills 
(give examples when you 
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- 2 - 



3. When do you write in English? You write in English when... 

write to my child' s teacher 

fill out job application forms 

fill out credit card application form 

fill out medical history form 

out rental /housing contract 

write letter of complaint to the store, etc. 

write letter to friend (what nationality?) 

fill out crossword puzzles 

. take an exam (what kind of exam?) 

write telephone messages 

Give other samples when you need to write in English 



4 . 



PROBLEMS - Speaking English .... 

abou . t a P r °t>lem when you needed to sneak in Rnrris oh u,,«- 

b^ause y°u didn't speak Englisif^Sll enoSfh aist week 
last month, 3 months ago, 6 months ago, a year ago, etc.) 




5 . 



PROBLEMS - Reading in English 

. SE'ta? a U di?£?oSu e ?ime e ?erdLg eeded “ in En9li9h ' bUt 



PROBLEMS - Writing in English 

Thin£ about a problem when you needed to write in Enalish hi,<- 
English/ difficult g beoause ^iMtte^gh 
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THIS WEEKEND I USED ENGLISH 
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350 topics 



m,p * ***** 



toa * Import^ °' Whal ta lm POttant to you. t ta MOST IMORTANT. 11 Igft. 



^Government Mate and federal government, citizen 



Consumerism: Savingsfcheckfng accounts credit ra,H. 

make -^rcompiaWan^^^^*- 

d<% _ i: ■ ... 



. - — — ,TO1 '"'wnauon 

describ^qimS^s. , ^iate < a , d^^*sap^Sn^^* >e l S and direc «<«>s. 



Holidays: | S am about historical event and n* . u 

ceiebrated, compare with hoiida " 



Legal services: 



information re P°rt. request 



and T^^hedu l |es erStandfn9 adS **** commerdaj8 » weather forecasts 



Telephone: 

companies for service "™ GCOfdm 9 s « call utHMy 



Transportation: 



,fcense 



events'to own , <^Im^ ed " a speciflc flme - compare with historical 



ndmg a Job. want ads. applications, interview, getting job information. 

fin 



9chedute eh « 09 e. ^ety on 



“•In onter 1 - 4 of what you need to work on the moat 
Uatening Riding wriring 



Speaking 
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Please prioritize these topics. Write #1 next to the topic you most interested ,n studying. 
Continue numbering until you have put all the topics in rank order. 

Civics/Government of USA: citizenship, government duties, etc. 

Consumerism: buying/selling/retuming purchases (house, car, etc.) 

Finding Work: job interviews, letters, where & how to look. 

Health: identify diseases, make appointments, fill out forms. 

History: historical figures, US history-early to modern. 

Holidays: study US holidays, celebrations and customs. 

Legal Services: local court system, discrimination, violations. 
Media: newspapers, television, ads, editorials, etc. — reading. 

Telephone: making and taking calls, asking for service, etc. 

Transportation: Getting driver's license, traffic tickets, rules, etc. 
Working In the USA: job evaluations, problem solving, etc. 

Please prioritize these topics. Write #1 next to the topic you most interested in studying. 
Continue numbering until you have put all the topics in rank order. 

Civics/Government of USA: citizenship, government duties, etc. 

Consumerism: buying/selling/retuming purchases (house, car, etc.) 

Finding Work: job interviews, letters, where & how to look. 

Health: identify diseases, make appointments, fill out forms. 

History, historical figures, US history-early to modem. 

Holidays: study US holidays, celebrations and customs. 

Legal Services: local court system, discrimination, violations. 

Media: newspapers, television, ads, editorials, etc. — reading. 

Telephone: making and taking calls, asking for service, etc. 

Transportation: Getting driver’s license, traffic tickets, rules, etc. 

Working In the USA: job evaluations, problem solving, etc. 



UNIT 





vH 

rr 



CM 



GROUP# 



AS A GROUP, CHOOSE WHAT YOU THINK ARE THE 5 MOST 
IMPORTANT TOPICS FOR YOU TO LEARN ABOUT. CHOOSE 
FROM THE FOLLOWING TOPICS: 

HOUSING (living in an apartment, etc.) 
CONSUMERISM (buying things) 

HEALTH 

WORK 1 (finding a job) 

WORK 2 (on the job) 

LEGAL SERVICES 
MEDIA (newspapers, TV) 

TELEPHONE/COMMUNICATION 

TRANSPORTATION 

GOVERNMENT 

HISTORY 



1 

2 

3 

4 

5 



As a group decide what you need to learn in order to have success in 
that topic. Think about what you need to do in ENGLISH when 
dealing with the telephone or transportation or housing - whatever 
topics you have chosen. Think about problems you have had and 
what you need to learn in order not to have those problems 
again. 
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NAME 



DATE 



1; Please explain why you need more English. Be specific with examples of situations which are 
difficult for you now. 



2. What problem area do you want to improve before you leave this class? 



3. When people speak English to you, do you understand: 

100% 80% 65% _50% _ less than 50% 

4. When you speak English, do people understand you. 

100% 80% 65% — 50% _ less than 50% 

5. When you watch TV, how much do you understand? 

everything most — some — a little — very little 

6 Please ORDER the skills that you need from 1 to 6. Numberl 's the ID2§i. 
the lanat Important to you at this time. Please use each number only once. 



READING 

WRITING 

LISTENING 

SPEAKING 

VOCABULARY 

PRONUNCIATION 

7. Have you ever studied English in the past? ___ yes — no 
Where? When? 



How long? 
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fcead the following topics. Order the topics that you would like to study. 

IMPORTANT and 9 is the LEAST IMPORTANT. 



1 is the MOST 



TEST TAKING SKILLS: How do you prepare, study for and take standardized tests? 



SPEAKING: GIVING ORAL PRESENTATIONS AND COMMUNICATING ON THE 
TELEPHONE: How do you research, organize and give oral presentations? How do you 
improve listening comprehension and speaking fluency in telephone conversations? 



NOTE TAKING: How do you take effective notes from lectures, oral presentations and 
written materials? 



WRITING: How do you brainstorm, organize, develop topic sentences, write, revise and edit 
your writing? 



READING: How do you improve reading speed and comprehension in both test and non- 
test situations? 



LEGAL How do you get and interpret information about laws, including immigration, crime 
and traffic violations? 

FINDING WORK IN THE USA: How do you fill out complex job applications, write a 
resume, prepare and follow-up on a job interview? 

WORKING IN THE USA: How do you express complaints, make requests, ask for a raise or 
write a letter of resignation? 



MEDIA: How do you read and interpret newspaper articles, print ads and TV commercials? 



OTHER: 
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ANSWER FOR YOU 





Who did you speak to? 


What did you say? 


Was it easy? 
Was it difficult? 


i At home? 






Easy 

A little difficult 
Difficult 


At work? 






Easy 

A little difficult 
Difficult 


At the store 






Easy 

A little difficult 
Difficult 



ASK YOUR PARTNER 





Who did you speak to? 


What did you say? 


Was it easy? 
Was it difficult? 


At home? 






Easy 

A little difficult 
Difficult 


At work? 






Easy 

A little difficult 
Difficult 


At the store? 






Easy 

A little difficult 
Difficult 



Donna Moss TESOL 94 Alternative Assessment: A fork in the road 
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writing Survey 

_ 1. What languages do you write in? - 



2. What do you writ, in your own language i„ English? 



own English 



checks/money orders 
diary 

forms/ applications 

stories/poems 

work reports 

homework 

Other 



ctsi English 



notes to self 
order forma 
letters 

notes at work _ 
notes to school 



3. How much time do you usually write each week? 

not at ail > f.w .inut.s on . hour 

2 ' 3 hour » ♦ or aor. hour* 

4 . What do you like to write, the mos t? 

5. Do you write at work? 

If yes, what do you write? \ 

6. Circle the one that is true for your 

writing 1 



writing is- 



h. very interesting s. 

C. very boring. 



OK 



•••y a little difficult 

C. very difficult 
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Reading Log 



In order to improve your reading skills, 

\ re f°5 d of what you read in Y° u * free time, 
cnart below as often as possible. 



you will need to keep 
Please fill out the 




Assessment of 

READING AND WRITING PRACTICES 



Name 



Date 



Provide as much informat.on as poss.ble in answering the following questions: 







Source: El Paso Community 
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Student self-evaluation 



^ So/ s -5 o 

Rate your job in English class. Read the following statements and decide what score 
to give yourself. Be honest! 

Scores: 1 excellent 2 good 3 OK 4 needs improvement 

1) I usually take notes in class. 

2) I always speak English in class (not my native language). 

3) I speak English outside of class (with co-workers, etc.) 

4) I review my notes at home on a regular basis. 

5) I use an ESL or English dictionary to look up some vocabulary. 

6) I attend class regularly and come on time! 

7) I try to use the English I’m learning in my everyday life. 

8) I ask the teacher clarification questions when I don’t understand. 



Now it’s your turn to evaluate the teacher!! 

Please give me scores (same scale) on the following topics. Be honest, don’t feel you 
have to be nice to me! 

Writing practices. Dialogue journals. 

Speaking practices. Conversation opportunities. 

I 

Reading practices. Listening practices. 

Please add your suggestions on how I could make the class better next cycle: 
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Comparison and Contrast: 

Strategies for Organizing Writing Material: 

Gathering Information 

1. Set up a chart for the points of comparison. 

2. Collect data/information/statistics. 

3. Double check accuracy of data. 

4. 

5. 

Making a Paragraph 

1 . Organize the facts by subtopics. 

2. Write topic sentences to connect the ideas together. 

3. Use connectors and comparison words and phrases to compare facts. 

4. After the facts have been presented, include a personal opinion regarding the facts 
or a conclusion based on the facts for each paragraph 

5. 

. 6 . 

Checking a Paragraph 

1 . Revise: check for errors in: 

Spelling Punctuation and Capitalization 

Grammar Word Choice 

2. Have someone read your paragraph. 

3. Connect each paragraph to the next one, if possible. 

4. Have someone else read your finished paper. 

5. Continue to revise as needed. 

6 . 

O ~ iaron McKay): TESOL 94: A Fort< in the Road: Alternative Assessment 
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READING 



Group Members : 



In your groups, discuss the following questions: 

1. What kinds of things do you read in English at home or at work? 



2. How do you read? Do you read for a short time 
Do you stop in the middle to think about your 
environment do you like when you are reading? 



or a long time? 
reading? What 



1 . 

2 . 

3. 

4. 

5. 

3. What kinds of things do you like to read? 



4. What kind of things do you expect to read when you go on to 
College or Vocational training? How do you think it might be 
different from now? y oe 



^ at kinds of problems do you experiece when you read’ 

Why is each one a problem? Discuss any or all of the following: 

Vocabulary 

Using a dictionary quickly and efficiently 
Sentence structure 
Technical language 
Unknown subjects 
Remembering previous reading 
Putting the overall meaning together 
Understanding the writer's purpose 
Understanding the main idea 
Distinguishing between fact or fiction 
Other: 



5 . 



Discuss some possible solutions 

PROBLEM 



for these problems : 

SOLUTION 



(Sharon McKay): TESOL 94: 



58 

A Fork in the Road: Alternative Assessment 



Name Date 

1 . , What did you do to prepare for the test? Sleep? Food?... 



2. How did you budget your time for the test? Did you spend too much or too little time 
on one section? 



3. Did you have any problems with the instructions? Were they clear for you? 



4. How do you think you did on the Listening Section? ( right out of 20) Why? 



5. How do you think you did on the Grammar Section? ( right out of 30) Why? 



.6. How do you think you did on the Vocabulary Section? ( right out of 30) Why? 



7. How do you think you did on the Reading Section? ( right out of 20) Why? 



8. Do you think the preparation in class helped you with the test? Why or why not? 



9. What would you do in the future to prepare yourself for a test similar to this? 
Please be specific. 
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Name of PRESENTER: Date: 

Name of Evaluator: 

TOPIC: 



MAIN IDEAS: 



Rate the Speaker on the following: 


GOOD 


FAIR 


POOR 


1 . Spoke clearly 








2. Spoke at a moderate speed 








3. Gave a clear main idea 








4. Gave a good preview of the talk 








5. Gave ideas in a logical order 








6. Used supplementary material well 








7. Stayed on the initial topic 








8. Presented an interesting conclusion 








9. Answered questions adequately 
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WRITING CHECKLIST 



1 . Are the paragraphs indented? 

2. Does the paragraph have a main idea? 

3. Is the spelling correct? 

4. Are proper names capitalized? 

5. Are the articles (a/an/the) correct? 

6. Are the sentences complete? 

Do they have a Subject and a verb? 

7. Are the commas In the right place? 



WRITING CHECKLIST 

1 . Are the paragraphs Indented? 

2. Does the paragraph have a main idea? 

3. !s the spelling correct? 

4. Are proper names capitalized? 

5. Are the articles (a/an/the) correct? 

6. Are the sentences complete? 

Do they have a Subject and a verb? 

7. Are the commas in the right place? 

O (Sharon McKay): TESOL 94: A Fork In the Road: Alternative AssessJ&A 



|| A . Name 


3. Languages 


c. what? 


D. At Work? 


E. Like/Don' t 
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Name 

Date 



Where did you speak English this week? 



Who did you speak English to? 



What did you read in English this week?. 



This week I needed to study 



This week W as difficult in class. 

This week was easy in 

class. 

You are doing great work in 

English! 

Donna Moss TESOL 94 Alternative Assessmnet: A fork in the road 
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Writing-- Analytic Scale 



APPENDIX B 




CD 
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Writing-Quick form 
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APPENDIX C 



Name: 
Address: 
Telephone #: 



■ • • EMERGENCY • • * 

Name: 

Telephone #: 

Combo Test Date Score 



Current Teacher: 
Level: 

Site: 

Time: 

Do Not Change #: 

Start Date: 

Type Enroll: 



Dispo: C15 C16 C17 C18 C19 



New Level: 



Reregis: 



Previous Cycles: 

Start Date Site Type Teacher Level 



Time Hours Dispo 



Log Number: 



Attendance Record 



M 


T\ 


W 


:: th 


F 



























































































































REEP E SL PROGRESS REPORT: Language Skill Assessment 

Student’s Goal: 



Please mark (X) in appropriate boxes. Tester's 



BEGINNING 


100 


150 


200 


250 


ill! 


3SO 


liii 


|| 'sm 


Exit 


Reading 




















Writing 




















Speaking 




















Listening 





















Please write (F)air, (S)atisfactory, ( G)ood , or (E)xcellent. 



MID 


PROGRESS 


Reading 




Writing 




Speaking 




Listening 





Please mark (X) in appropriate boxes. 



FINAL 


100 


150 


200 


250 


300 


350 


450 


550 




Reading 




















Writing 




















Speaking 




















Listening 





















Teacher’s Signature/Date: 




Teacher's Comments: 



Student’s Signature /Date Adornments: 



Teacher’s Comments: 



Student’s Signature/Date/Comments: 
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Proficiency Levels --Writing 



Overview and Purpose 

_ r 

A goal (objective B) of the Alternative Assessment Project was 
to create benchmarks for success along various dimensions of 
language and literacy development. Writing was one of these 
dimensions. Although writing entry-level descriptions and 
curriculum objectives were revised under the Transition Project, 
an assessment scale that could be used to evaluate writing samples 
across all components of REEP's ESL program was lacking. 
Validation of level descriptions for writing and creating an 
assessment scale were major activities in year 2 of the alternative 
assessment project. 

Process 

1. During the summer of 1994, Carol collected writing samples 
from both day and evening classes at all levels. She grouped 
and analyzed them for characteristics of writing development 
that described what a writer could do for each grouping. It 
appeared that we had three levels of writing among learners in 
our program. 

2. To check this hypothesis and create an assessment scale, Donna 
and Pat joined Carol (January, 1995) to form the Alternative 
Assessment Writing Study Group. Additional samples were 
collected from the next cycle of classes and divided among the 
study group. The task was to group the samples, note 
identifying characteristics of writing development, and come 
to consensus about writing levels and their definitions. 
Carol's hypothesis was confirmed. 

3. Various writing scales were examined. Two (one analytic and 
one holistic) were chosen to use as evaluation tools for yet 
another set of writing samples. We wanted to see if using 
rating scales would give us the same levels. Without any 
prior discussion of how to use the scales, we rated papers 
with a high degree of consistency. 

4. From these scales and our list of writing characteristics 
gleaned from our analysis of writing samples, we created an 
analytic scale to field test. 

5. The field-test produced a high rate of scoring consistency. 
It was refined and a holistic scale was constructed based on 
this analytic scale. 

6. These scales were then compared to entry-level descriptions 
and curricular objectives for each level. 

Outcomes 

A. Three levels of general writing proficiency have been defined. 
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These levels can serve as descriptors to various stakeholders 
of what learners can do in writing. Our instructional levels 
feed into these proficiency levels: I (100,150,200), II 

(250,300,350), and III (450,550). The proficiency levels can 
be further broken down into low-high across 8 characteristics 
of writing development: Topic, Organization, 

Vocabulary , Grammar , Sentence Structure, Spelling, Mechanics, 
and Voice. These are the characteristics that emerged as 
important indicators of writing development during our study. 
We then created an analytic assessment scale ranging from 0-6 
for each of these characteristics. 

B. Within a general proficiency level, curricular objectives and 
evaluation criteria fluctuate between low and high on the 
scale depending upon the entry level description and hence, 
how a learner actually writes at that level. Various 
combinations of writing development characteristics account 
for differences among instructional levels. Progress can be 
indicated by movement through instructional levels even though 
a learner may not jump to a higher proficiency level. This 
can be documented by applying the analytic scale to learner 
writing samples. As learners progress, an increasing number 
of writing characteristics move up to higher ratings on the 
scale . 

C. It is interesting to note that when we had difficulty 
assessing what level to assign to a writing sample, it was 
usually, indeed, a fence sitter! For example, when I applied 
the analytic scale to a sample I wasn't sure about, I 
discovered that 4 of the characteristics belonged to level I 
and 4 to level II. 

D. The general proficiency levels correlated with entry level 
descriptions, curricular objectives, and present placement 
test scores: 



General 

Proficiency 


I 


II 


III 


REEP Entry 
level 


100,150,200 


250,300,350 


450,550 


Placement 

score 


0-2(4) 


4-6 


8-10 



Comparisons with the entry level descriptions called for minor 
adjustments of the description or curricular objectives and 
evaluation criteria. These were incorporated in the most 
recent printing (June, 1995) . 

Recommendations 

1. Analysis of placement: The scales should be field-tested on 
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writing samples obtained from the placement test. The 
holistic scale does not discriminate among instructional 
levels. Such a field test would yield data on adjusting the 
' scale so instructional level determinations could be made if 
the program chooses to adapt this scale for placement testing 
assessment. 

2. Systematic assessment of writing samples can now be put into 
place for reporting writing outcomes on a learner profile. 
The assessment scale is ready, but a list of topics needs to 
be identified for each level along with criteria for how to 
assignment is given to students- -i . e . "Write about someone 
important to you." or "Write an essay with introduction, 
supporting details and conclusion ..." Keep in mind that 
copying a model is practice and free writing is assessment. 

3. The process of determining general proficiency levels should 
be applied to other skill areas. Initial work with oral 
proficiency samples indicates that a similar situation exists- 
-instructional levels feed into general proficiency levels. 
The next steps would be to determine these levels/outcomes and 
develop assessment tasks to evaluate them. 



(Submitted by Carol Van Duzer, June 30, 1995) 
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Writing-Analytic Scale 
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Writing-Quick form 
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